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Abstract. For a finitely generated group r denote by fi(T) the growth coeffi- 
cient of r, that is, the infimum over all real numbers d such that Sn(r) < n\ d . 
We show that the growth coefficient of a virtually free group is always rational, 
and that every rational number occurs as growth coefficient of some virtually 
free group. 



For a finitely generated group Y denote by s n (T) the number of subgroups of 
index n in Y, and define the growth coefficient /x(r) as 

rrN r logs„(r) 
fj,(i)= iim sup . 

n^oo n log 71 

This quantity has been computed in a variety of cases, including free product of 
finite groups [5], Fuchsian groups [6], and certain one-relator groups [7]. In all 
these examples, fjt(T) can be expressed as —I + ^ i=1 (l — — ) for certain integers 
n, > 2. This observation led to the question as to which values ^(Y) can attain; 
in particular, in [8] it was asked whether there exists a sequence of groups (r„), 
such that jtt(r n ) converges from above. This question is answered by the following 
Theorem. 

Theorem 1. The set {/i(F) : Y finitely generated, virtually free} is equal to the set 
of non-negative rational numbers. 

The proof of this result falls into two steps, the first one being the construction 
of virtually free groups with given growth coefficient, these groups are described in 
the following theorem. 

Theorem 2. Let k,£ be integers, p a prime number, and suppose that k — ip > 2. 
Define the group Y p ^,£ as the amalgamated product Sk *c p Sk, where a generator 
of C p is mapped onto an element consisting of I cycles of length p in both groups. 
Similarly, for p odd or p = 2 and I even, let Y^ k £ be the amalgamated product 
Ak *c p Ak- Then we have 

(p-l)£+l + S 
V{Lp,k,e) - 1 7 j 

where 5—1 if p = 2 and £ is odd, and 6 = otherwise, apart from the exceptions 
(p, k, £) = (2, 5, 2), (3, 7, 2), for which we have ^^2,5,2) = \ and ^(^7^) = |, and 

K T p,k,e) = 1 1 

with the exceptions /tt(r^ 5 2 ) = \ and /i(r^" 7 2 ) = |. 

In a second step we have to show that the growth coefficient of any virtually free 
group is rational. This is implied by the following result. 
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Theorem 3. Let T be a finitely generated virtually free group, represented by a 
finite graph of finite groups Q. Then the growth coefficient of T is the solution 
of a linear optimization problem with rational coefficients which can effectively be 
computed from Q. In particular, /i(r) is rational. 

To prove Theorem [5] we have to compute the growth coefficient of a free product 
with a cyclic group of prime order amalgamated, which can be done in greater 
generality. 

Proposition 1. Let G be a finite group, x £ G an element of prime order p, and 
suppose that \G\ > 2p. Set T — G *( x ) G, where x is embedded in both copies of G 
in the same way. Denote the conjugacy class of x by [x]. Then fi(T) is given as 

, x i /(IN n #!)(£>- 1) 2 

(1) fi(T) = - + max ' 1 - ' 



p h<g\ \[x]\p (G:H) 

As another application of Proposition [T] we can compare the subgroup growth 
of an amalgam with its free subgroup growth. As was shown by Muller[5], the 
free subgroup growth is determined by the Euler characteristics, more precisely, 
defining ^/(r) = limsup,^^ ^fi~^ , where s{(r) is the number of free subgroups 
of index n in T, we have for every virtually free group T the relation /i/(T) = 
— x(r). Obviously, we always have //(T) > /J,f(T). For the case that N is normal 
in both G and H it is shown in [5] that n(G * N H) = fJ,((G/N) * (H/N)), while 
x(G*nH) = jgy + pry — ]W~\ c l eari y depends on TV. This leads to the question under 
which conditions we have fx(T) = — x(r)- A first answer is given by the following. 

Proposition 2. Let G be a finite group, x G G an element of prime order p, and 
set r = G *c P G, where a generator of the cyclic group is mapped onto x in both 
copies of G. Then (m(T) — — x(r) holds true if and only if \Nq((x))\ < 2p. 

The algorithm to compute fJ-(T) from a graph of finite groups with fundamental 
group T is about as difficult to perform as compiling a complete list of all subgroups 
of the vertex groups of the graph, which becomes a difficult problem already for 
relatively small groups as Ss, which has 151221 subgroups. However, if this infor- 
mation is available, solving the resulting linear system is quite easy. 

Proposition 3. Let T be the fundamental group of the graph of groups, 




where the embeddings of C2 identify one reflection in D\o with the element (12) 
in one symmetric group, and another reflection with (13) in the other symmetric 
group. Then we have /j,(T) = | and x(r) = — 
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Our second example is a simpler graph of groups with a more complicated amal- 
gamated subgroup. 

Proposition 4. Let T be the amalgamated product S4 *c 2 xc 2 Si> where the sub- 
groups {1,(12)(34),(13)(24),(14)(23)} and {1, (12), (34), (12)(34)} are identified. 
Then /i(r) = \ and x(T) = -\. 

1. Some basic observations 
Lemma 1. Let T be a finitely generated group. Then we have 

log|Hom(r,S„)| 



/x(r) = limsup ■ 



nloe 



Proof. Denote the right-hand side of the equation to be proven by fih (T) , and let 
t n (T) be the number of homomorphisms r — > S n with transitive image. Then 
s„(r) = ; which implies fi(T) < /i/j(r). For the reverse inequality suppose 

that fi(T) < jttft(r) — 5 for some (5 > 0, and let C be a constant such that s n (T) < 
Q n \Hh(r)-S/2 ^Qjjjg ^ rue f or a n n > L e ^ be a partition of the set 

{1, . . . , n}. Then the number of homomorphisms ip : T — > S n with image having 
precisely the sets ft-i as orbits equals 



|\l+^ h -5/ 2 



Let A = (Ai,...,Afe) be a partition of n. Then the number of homomorphisms 
tp : r — > S n such that the orbits of the image have sizes Ai , . . . , Afc equals the 
quantity above multiplied by the number of ways to partition a set of n elements 
appropriately, this number in turn is bounded above by ( Ai ™ ^ J , and we find that 
the number of homomorphisms associated to a partition A is at most 



k k 

n 



Ai, . . . , A 



C* Y[(Xi\) 1+fih ~ 5/2 = n\C k Y[{\ l \) t * h - s/2 < n\ 1+l * h - s/2 C k 



i=l 



Since the number of partitions grows subexponentially with n, we deduce that the 
number of all homomorphisms ip : T — >■ S n is bounded above by n \ 1 +^h-s/2 e cn ^ 
which yields the contradiction /i^ < jih — 5/2. □ 

We now show how to deduce Theorem Q] from Theorem [2] and [3l Obviously, it 
suffices to show that for each rational number ? with a, b > there exists a virtually 
free group T with fj,(T) — f. Suppose first that < f < 1, and that b — a is odd. Let 
p > b be a prime number satisfying (p — 1, b — a) = 1. Such a prime number exists, 
since b — a is odd, and therefore the residue class 2 (mod b — a) contains infinitely 
many primes, each of which suffices for our purpose. Now p — 1 is invertible modulo 
b — a, let 1 < £ < b — a — 1 be the integer satisfying (p — 1)1 = — 1 (mod b — a). 
Finally, set k = h ^ p h /}^ +b ■ Provided that £p < k — 2, we can apply Theorem [5] to 
find 

(b-a)(p- l)£ + b-a _ a 

M(rp - M) 1 bi( P -i) + b T 

To bound £p, note that 

(p- 1)1+1 o 
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thus 

pi < p{b-a) _ pa - b < _ 2 
fc " (p- 1)6 " jfc " jfe' 

that is, the condition pi < k — 2 is indeed satisfied. 

Next, suppose that b — a is even, and that 6 is odd. Let p > b be a prime number 
such that (p — 1, b — a) = 2, let 1 < £ < b — a — 1 be a solution of the congruence 
£(p — 1) = —2 (mod b — a), and set /c = M (p~ 1 )+ 2fc , Then we argue as above to find 



b- 

(b-a)(p-l)e+2(b-a) _ a 



b£(p - 1) + 2b b' 

Hence, our claim holds true for all rational numbers in (0,1). Now let r be an 
integer, ^ £ (0, 1) a rational number, and T a ^ a virtually free group with p.(T ai b) — 
#. Consider the free product T = r 0j 6 * F r . We have 

|Hom(T,5 B )| = [Hom(r o , 6 ,S , n )| • |Hom(F r , S n )\ = n! r |Hom(r M , S„)|, 

thus /x(r) = r + /x(r o> i,) = r + and we find virtually free groups with growth 
coefficient ^ for all non-integral positive rational numbers. Finally, all integral 
growth coefficients are realized by free groups, and our theorem is proven. 

2. Proof of Theorem [3] 

Lemma 2. For integers m < n we have m\ = n\ n / m e ot ^ n \ 

Proof. By Stirling's formula we have 

m! = m m e° {m ^ = {n n ) m ' n {m/n) m e 0{m ^ = n\ m ' n {m/n) m e° {m \ 

thus, it suffices to show that mlogn/m = 0{m). Differentiating with respect to m 
shows that the left hand side is maximal for m = n/e, and our claim follows. □ 

To every finitely generated virtually free group T we can associate a finite graph 
Q of finite groups, that is, a connected directed graph (V,E), such that for each 
edge e = (x, y) the reverse edge e = (y, x) is in E, together with a collection of finite 
groups G v , G e , v £ V, e £ E satisfying G e — G-g and embeddings tp e : G e — > G v for 
each edge e with target v. We define the fundamental group of Q as follows: Let T 
be a spanning tree of the underlying graph with all reverse edges added. Then let 
r be the group generated by all G v , v £ V and symbols g e for all e £ E subject to 
the relations 

(1) g e = 1 for all e £ T, 

(2) g e = g g for all e £ E, 

(3) g e ^ e (a)g^ 1 = t/> g (a) for all e £ E, a £ G e . 

We remark without proof that the fundamental group does not depend on the 
choice of the tree T, and that every finitely generated virtually finite group occurs 
as fundamental group of some finite graph of finite groups, for these and related 
results we refer the reader to |10) . 

Note that each vertex group is embedded in T, thus, each representation <p : T — > 
S n induces representations ip v : G v — > S n . On the other hand, not all tuples of 
representations <p v : G v — > S n can be lifted to representations of the whole group. 
For each tuple of representations {(f v : G v — > S n , v £ V}, and every edge e = (x, y), 
the embeddings ip e : G e — > G x , ip s : G e — > G y induce two representations of G e , 
which obviously have to coincide to allow for a lift. On the other hand, it is obvious 
from the list of relations given above, that every tuple of representations of the G v 
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satisfying these conditions lift to representation of T; in this case we will call the 
tuple (ip v : G v — > S n ,v <G V) admissible. Note that admissibility only depends on 
the equivalence classes of the representations ip v ; we will refer to these data as the 
representation type of the tuple. The number of different equivalence classes of 
permutation representations of degree n of a finite group equals the number of non- 
negative integral solution (xi , . . . , x mv ) of the equation Y^i x i n v,i = d, that is, 
the number of lattice points in a certain domain, which is contained in [0, n] m " . In 
particular, the number of different equivalence classes grows at most polynomially, 
and the value of p,(T) does not change if we replace the number of all permutation 
representations by the maximal number of permutation representations of T with 
prescribed representation type. Hence, to compute p,(T) we have to determine 
among all admissible representation types the one leading to the greatest number 
of representations, and to compute this number. 

Permutation representations of G v are direct sums of transitive representations, 
which in turn are equivalent to the coset action of G v . For each v G V, we therefore 
consider a complete list of transitive permutation representations p v .i, 1 < i < m v 
of G v , and let n Vt i be the number of points p v ^ acts upon. Then the equivalence 
class of ip v : G v — > S n is determined by the multiplicities 1 < i < m v ) with 
which p v .i occurs in ip v . A given representation type v ev is admissible, if 

l<i<m„ 

for each edge (a;, y) e E, the actions of G e induced from the action of G x and 
of G y coincide. To check this, note that each transitive action of G x gives rise 
to a permutation representation of G e , which in turn decomposes into transitive 
G e -actions. Hence, if p e .i, 1 < i < m e is a complete list of transitive permutation 
representations of G e , the multiplicities of the transitive actions of G e in the action 
induced from G x is the image of the vector (£ x ,i)i<i<m x under a certain linear map 
given by a m e x m^-matrix with non-negative integral entries, and the condition 
of admissability becomes a system of m e linear equations between the m x + m y 
variables £ y j, 1 < i < m x , 1 < j < m y . 

Hence, we have shown that admissability of a representation is equivalent to a 
certain set of linear equations with integral coefficients in the variables v ev ■ 

l<i<m„ 

Next, we compute the number of representations for a given admissible repre- 
sentation type. To do so, we first choose representations of the finite groups G v . 
For each i < m v we have to choose ^ orbits of size n v ^, the number of ways to 
do so is 

n! 

An action of G v similar to p v ^ is equivalent to the action of G v on the cosets of a 
subgroup Ui of index n Vti . Hence, to construct an action of G v similar to p v .i on a 
given set of n v ^ points, we have to identify these points with the cosets G v /U v ^. 
Two identifications give the same representation if and only if one is obtained from 
the other by shifting the cosets by some element g £ G v , that is, to count different 
actions we have to fix one point which we identify with the coset U Vt i itself. Hence, 
there are (n Vi i — 1)1 different actions equivalent to p Vi i, and we conclude that the 
number of representations of G v of the given type equals 
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We assume that the representation type is admissible, thus, for each edge e there 
exist g e such that relations of type (3) hold. However, the relations of the first type 
require that the edge groups do not act similarly, but are actually equal. Hence, 
the number of representations of the fundamental group of the graph of groups 
consisting only of the vertices in T with given representation type equals 



(2) n ^ , u t n 



vev 



where £ e ^ is the linear form giving the multiplicity of p e ,i in the restriction of 
Yli^i £v,iPv,i to G e . Obviously, £ is a positive linear form with integral coefficients. 

Finally, we have to choose the image of g e , e S E\T. To do so we have to respect 
relations of the third type, that is, the number of possibilities to choose g e for e 
equals the centralizer of a representation of G e of the type induced by the type of 
G x . This number equals 



lt A*(Ul.-A.,m„) 



thus the total number of representations of F with representation type vev 

l<i<m, 

equals 

n! IAT|-Q _ " ! -Q /_ n\ _\ 

Yli=l(^v,iy-n v i ( x ,y)eE \IL=1 ^e,i(£x,li • ■ • ' £z,m„ ) '' ' / 



We can now apply Lemma [5] together with the fact that the number of edges in T 
equals \V\ — 1 to see that the logarithm of this quantity is equal to 



(ilogn l-^^(„ ! ,/n+ ^2 4,;(£x,i,---,£x,mJAi J +0{n). 

y v£V i=l (x,y)EE } 

We are looking for integers £ u j, such that this expression becomes maximal. To do 
so, we first determine real numbers a Vj i subject to conditions a Vt i > 0, X^="i a v,i = 
1, and the equations implying admissability, such that the linear form 

^ ^ C^v.i ^ ^e,i (^x,l 7 ■ • ■ 5 0£%,m v ) 

»EV !=1 [x,y)eE 

becomes maximal. This optimization problem can be solved using only matrix 
operations, hence, the solution is rational, since both the linear constraints as well 
as the function to be maximized are rational. Let m be the least common multiple of 
all denominators occurring in the optimum, and let fj,Q be the value of the problem. 
If n is divisible by m, this rational solution gives rise to an integral solution for 
the £ Vt i, and therefore to the right number of representations, which gives the lower 
bound /i(F) > [Iq. On the other hand, for integral values of j, the value of the 
linear problem is always bounded by the maximum over all real values, and we 
deduce n(T) — /xq, which proves theorem [3J 
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3. Proof of Propositions Q] and [2] 

Lemma 3. LetG be a finite group, x G G an element of order p, U < G a subgroup, 
ip : G — > SrQ.m the coset representation associated to U . Then the multiplicity of 
the trivial representation in the restriction of ip to (x) is ^THTp^rp ■ 

Proof. A coset all is fixed by x if and only if x a G U. For each element in U 
conjugate to x, there are Cg(x) possible a conjugating x onto this element, and 
there are \U\ different a defining the same coset, hence our claim. □ 

Proof of Proposition [7J Since the amalgamated subgroup has only two inequivalent 
transitive permutation representations, the condition of admissability reduces to the 
condition that the number of fixed points of the reduced actions coincide. Hence, 
denoting by U\, . . . , U m a complete list of subgroups of G, a representation type 
(£i,j)i<«<2 is admissible if and only if 

Since there is only one edge we remove the subscript e from the linear function 
used in ([2]), as well as the subscript x from the variables Then 4(6, . . . , £ m ) 
equals the number of trivial representations in the restriction of a representation of 
G similar to ®"Lj 6 ' Pi to C p . By the previous Lemma we obtain 

Since the degree of the representation does not change when restricting it to a 
subgroup, and C p has only two transitive representations, we obtain 



1 m 

4(6, •••,&») = -(£; " 4(6, ■ • , 6n)) , 

since YlTLi — n we deduce 



P i=l 



The summand 2 clearly does not influence the optimization. The logarithm of the 
first factor in ([5]) becomes 

m m 

nlogn - lognE^ + = log^E^ _ •"•)& + C( n )> 

i=l i=l 

hence, the linear form to be maximized is given as 

our aim is to show that the maximum is attained in a point satisfying otx,j = cx2,j = 
1, otij =0 for j jo for some jo- Note first that if in the second summand of the 
definition of / we replace all aij by «2j , the value of / does not change in view 
of |[3]), and the first summand is of the form 5(0:1,1, . . . , ai, m ) + 3(02,1, . . . , 02, m) 
for a linear form g, thus, we may assume without loss that aij — a!2,j for all j. 
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Under this assumption ([3]) is trivially satisfied. Thus, we consider the maximum 
of a linear form on the set . . . , (3 m ) '■ A > 0,^3 A = 1}, which is either 0, 

or attained in a vertex (0, . . . , 0, 1, 0, . . . , 0). In the latter case our claim is proven, 
whereas in the former we would have (J-(T) = 0. However, as Miiller [4 showed, the 
number of free subgroups of T of index n\G\ is n! _x ^ r ^ G l + °^ 1 ^. In general, the Eulcr 
characteristics of an amalgamated product G*u H is given by + rjU — j^y, and, 
using the assumption |G| > 3p, we obtain the contradiction 

o = M(r)>^P = 4,-^> 1 



\G\ p\G\ |G| 2 -3p|G|' 



H = C p in Proposition [T] to obtain 



□ 

Proof of Proposition^ The Euler characteristics of G * Gp G equals — ^ + jgy- Set 



l \[x]n(x)\( P -i) _ 2p 
1Mb lei" 

Now \{x] n (x)\ = (N G ((x)) : C G {x)), and \[x}\ = (G : G G (x)), thus M (r) = - x (r) 
implies 

(N G ((x)) : C G (x))(p - 1) 2p-2 
(G:C G (x))p ~ |G| ' 

which is equivalent to \N G ({x))\ < 2p. To prove the converse, suppose that 
\N G ((x))\ < 2p, and that the subgroup H of G maximizing the right-hand side 
of (JT]) is not trivial. Since every subgroup not containing an element conjugate to 
x cannot maximize this expression, we have in particular that \H\ > p. Suppose 
first that p > 3. Then |A^g((^})| < p 2 , thus a p-Sylow subgroup P of G is cyclic of 
order p. For suppose otherwise. Then either x is central in P, which would imply 
\C G ({x))\ > \P\ > p 2 , or x is not central in P, in which case there is a central 
element y 6 P\ (x), which would imply \C G ({x})\ > \(x,y)\ > p 2 . Hence, in each 
p-Sylow subgroup of H, there are \[x] tl (x)\ — (N G ({x)) : (x)) elements conjugate 
to x. Similarly, if p = 2 and \Ch(x)\ is cyclic of order 2 or 4, there is one conjugate 
of x in every 2-Sylow subgroup of H . The number of p-Sylow subgroups of H is 
\H\/p at most, thus 

\[x]nH\ < l -^\[x] n (x}\ < l -^(N G ((x)) : (x)), 
p p 

and the right hand side of (JTJ) is bounded above by 

1 , \H\(N G ((x)):(x))(p-l) 2 < 1 , 2\H\(p-l) 2\H\ 



p (G : C G ((x)))p 2 (G : H) ~ p \G\p \G\ 

1 4(p-l) Ap 
~ P \G\ \G\ 

since 2^1 < 2 and |#| > 2p. 

It remains to consider the case p = 2, Ch {x) = G2xG2- Since Ch(x) < N G ((x)), 
and |iVG>(xc) | < 2p — 4, we deduce N G ((x)) = Ch(x), which implies |Gc(a;)| = 4. 
We therefore obtain (~]H\ < \[x] \ = and with this bound the right hand side 
of ([1]) becomes 



1 \H\IA 2 1 Z\H\ 1 6 

- + - — = — - < < -yfD 

2 2|G|/4 (G:H) 2 2\G\ ~ 2 \G\ XKh 
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and the proposition is proven. □ 

4. Proof of Theorem [2] 

We now prove Theorem [5J We have to consider 3 cases, depending on whether 
x is an odd permutation or not, and whether we consider Sk *c p Sk or A/~ *c p Ak- 
Note that in the latter case x is necessarily even, which is the reason we do not 
have 4 cases. The computations are the same for all these cases, we only give them 
here for the case Sk *c p Sk and x even, that is, p ^ 2 or p = 2 and £ even. 

To apply Proposition [TJ we have to consider the maximum taken over all sub- 
groups of Sk- We claim that this maximum occurs for if — Ak-\, except for certain 
small values of k which lead to the exceptions in the theorem. In this case we have 

-o— j = t:, and \ \x] n if I equals the number of elements with £ p-cycles in Sk-i, 

thus, we obtain 

Vk— 1)! 

(|[x] n if |) _ (k-£ P -iy.a P e k - £p 



and therefore the value 



1 | (k-£ P )(p-l) 1 =1 £(p-l) + l 
p pk k k 

We want to show that for every other subgroup we obtain a smaller value, that is, 
we have to show that for each if < Sk different from Ak-i we have 

(\[x) n if |)0 - 1) 2 < ( fe -£p)(p-i) i 



\[x]\p (S k :H) pk k' 

We will do so in four steps: First, we consider intransitive subgroups, then tran- 
sitive, but imprimitive subgroups. In both cases we know that if is contained 
in some direct product or some wreath product, and these structures are simple 
enough to give upper bounds for |[x] (~1 if |. Next, we consider primitive subgroups. 
We know on one hand, that a proper primitive subgroup cannot be too large, on 
the other hand, we can show by direct construction that x cannot have too many 
fixed points, thus, \[x]\ has to be large. Comparing these estimates we obtain a 
contradiction, provided that n > 24. Finally, we check all primitive groups of order 
24 using GAP pQ. The quantity ^tctP^ has a probabilistic interpretation as fol- 
lows: Choose a permutation tt £ [x] at random. Then the probability for the event 
7r G if equals ^%jj~jr^ ■ It turns out that this interpretation is useful for computing 
upper bounds. 

An in transitive subgroup which does not contain Ak-i has an invariant set A 
with 2 < \A\ < n/2, thus we have to estimate the probability that a permutation 
with £ cycles of length p leaves a given set A of size m invariant. Denote this 
probability with P(k,£,m). Distinguishing the possibilities that a given p-cycle is 
totally inside or outside A, we obtain the recursion relation 

—J P(k-p,l- l,m-p)+ (l - — J P(k-p,£-l,m), 

which is valid for k > p and £ > 1. We use this relation to prove P(k, £, m) < ~T p 
for all m in the range 2 < m < fc/2by induction on k. Inserting the induction 
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hypothesis we have to prove the estimate 

k - lp /m\Pk-£p / m\Pk-£p 
k V k J k — p V k J k — p 



that is 



p fm\P / m\P 



k 



The expression on the right hand side is monotonically decreasing in m < k/2, 
thus, its maximal value is at m — 2, and we see that it suffices to prove 



k 



/2\p / 2\p 

(*) H'-k) ■ 



Suppose that k > 2p. Then the terms in the binomial expansion of (1 — 2/k) p are 
alternating and of decreasing modulus, thus we obtain an upper bound by deleting 
all terms except the first three, and find that we only have to prove 



k k 2 



p+1 ^ (2y ^ 2p 2p(p- 1) 

However, bounding the first summand on the right hand side by p-, and using the 
assumption k > 2p, this inequality is seen to hold true with the possible exceptions 
p = 2, k — 4, which can be checked directly. Hence, the induction step is correct 
for k > 2p. For k < 2p we have I = 1, in which case we compute P(k, £, m) directly 
to obtain 



P(k,l,m) 



< 



< 



(k — m)(k — m — 1) • • • (k — m — p + 1) 

k(k~ 1) ■■■(k 
(fc-2)(fc-3)---(fc-p- 1) 

k(k- 1) •••(fc 
(fc-p)(fc-p-l) 

k(k - 1) 
k — p 
k ' 



Hence, for intransitive subgroups our claim is proven. 

Next, we consider imprimitive subgroups. Without loss we may assume that 
H = S a l Sb, and denote by ir : H — >• Sb the canonical projection. 

We begin by considering some special cases, the first being the case p — b. If 
x G H , then either some S^-conjugate of x contains a cycles of length p, which 
contradicts the assumption Ip < k, or there are p domains of imprimitivity, each of 
which is an invariant set under each element of [x] C\H, and we can argue as in the 
case of intransitive groups. 

Next, suppose that a = p = 2, and denote by P(b,£) the probability that a 
random element x G Su consisting of I cycles of length 2 is contained in Si I Sb- 
Choose a domain of imprimitivity. Then this domain is either fixed pointwise, or 
a 2-cycle of x, or there are two 2-cycles of x mapping this domain onto another 
domain of imprimitivity. These cases are mutually exclusive, thus we can compute 
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the probability of each single case and obtain for I > 2 the recursion relation 



>-l\ 26(26-1) / 1 ' ' 



26- 1 V 26(26- 1) 

1 / (26-2f)(26-2£-l)\ 
+ 26 - 1 1 26(26 - 1) J 

(2b-2£-2)(2b-2£-3) 



(26- 2)(26- 3) 



P(b-2,£-2) 



where P(6 — 1, £) has to be interpreted as if 6 = I. Estimating all probabilities on 
the right hand side as well as the brackets (1 — . . .) by 1, we obtain the estimate 
P(b,£) < (2b ~ 2£ ^_y )+4b , which implies P(b,l) < 2b -^-\ and hence our claim, 
provided that 46£ +1 > 66 + A£ 2 , which is the case for all £ unless one of 6 < 7, 
^<lor^>6— 1 holds true. For I = 1 we immediatelly see that P(6, 1) = 2Ftt> 
which is small enough for all 6 > 3. For 6 — I we have 

P(5 ' h) = 26^1 (P(6 ~ 1,6 ~ 1} + P[b 2 ' 6 ~ 2)) ' 

which implies by a simple induction that P(b, 6) < p for all 6 > 6. For P(6, 6—1) 
the recursion implies 

P(b, b-l)< b{ ^_ l} P(b -1,6-1) + - 1, 6 - 2) + P(6 - 2, 6 - 3)) . 

Explicitc computation implies that P(6, 5) < 0.014 and P(7, 6) < 0.0051, together 
with the bound for P(6, 6) we obtain by induction that P(6, 6 — 1) < p- for all 
6 > 6, which is again acceptable. Thus, our claim is proven for all 6 > 8, and for 
the remaining values of 6 it can be checked directly using the recurrence relation 
above. 

Now we embark on the general case. Let x <G <Sfc be an clement with £ cycles of 
length p chosen at random; we estimate the probability that x G H. We distinguish 
two cases, depending on whether there exists a domain of imprimitivity which is 
left invariant by x or not. It suffices to show that in each case the conditional 
probability for the event x <G H is at most fc ~^'~ 1 . Suppose that x moves some 
domain of imprimitivity. Then x has a cycles of length p, all of which are mapped 
onto the same element under it; leaving away all other restrictions on x we obtain 
an upper bound for the probability in question. We get an even coarser bound, if 
we add the condition that all points in the first domain of imprimitivity are actually 
moved, and only ask whether the action on these other points is actually mapped 
onto the same cycle under n. We therefore obtain the upper bound 

(a-iy.P' 1 (a-iy.P^ik-pay. 



(k-p-a+l)(k-p-a)---(k-pa+l) (k-p-a + l)\ 

It suffices to show that the probability in question is < \. Compare the p — 1 
largest factors in the numerator, that is, a p_1 with the p — 1 largest factors in the 
denominator, that is, (k — p — a + 1) • • • (k — a — 2p + 3), and note that k = ab. 
Comparing these terms we obtain a contribution < (6 — 1 — 2p/a) 1 ~ p , continuing 
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in this way we find that the probability in question is at most 

((6 - 1 - 2p/a){b - 2 - 2p/a) ■■■(b-a- 2p/a)) 1 ~ P . 

All factors are at most 1, thus, to give an upper bound, we may single out any 
factor easily dealt with. If b > 2a + 4p/a, there is one factor < a -1 , and two factors 
< 2/6, hence, the whole product is less than 4/(a6 2 ) < l/(ab). Next, note that 
there are p — 1 factors which are less than i, thus, if 2 P_1 > ab, we are done. In 
view of the previous result we see that we may assume p < a, provided that a > 9. 
Again, these special cases can be excluded by looking at the original expression; we 
therefore obtain the restrictions b < 2a + 4,p < a. 

We now go back to the original fraction and note that in the denominator, there 
are (p — l)(a — 1) consecutive positive integers, hence, we obtain the upper bound 

(a-iy.p- 1 

(ap — a — p + 1)1 
This expression is decreasing as p increases, for p = 3 it becomes 

(a -IV 2 (2a -2V 1 1 1 
< r-s r- < 



(2a-2)\ V a - 1 / 2a 2 + Aa ab 7 

provided that a > 6, the remaining cases have to be checked individually again. 
Hence, we may assume p = 2, and the probability in question is equal to 

(a -1)1 



(ab-a - l)---(ab-2a + l] 



which is < \ unless b = 2, b = 3 and a < 6, b = 4 and a < 4, or a = 2. However, 

— ab 1 — ' — ' ' 

the special cases dealt with at the beginning imply that a, b > 3, and we are again 
lead to a few special cases which are easily excluded separately. 

Hence, for imprimitive H we always have TCjp < fc ~^~ 1 , and we do not have 
to consider such groups any more. 

To deal with primitive subgroups, we use the following. 

Lemma 4. Let H < Sk be a primitive subgroup, and suppose that one of the 
following two conditions hold true. 

(1) H contains a q-cycle for some prime number q < k — 4; 

(2) \H\ > 3 fc or \H\ > 2 k and k > 25. 

Then H is A n or S n . 

Proof. The first condition is due to (confer [3J II. Satz 4.5]), whereas the second 
was proven by Mar6ti[3]. □ 

Suppose that H < S n is primitive, not equal to S n or A n , and that ^tctt^ ^ 

——u—^- Define an equivalence relation on [x] as follows: Two elements y, z are 
equivalent, if the I sets of p points in the p-cycles of y and z are equal, and if the 
action of y and z is the same on each of these sets with the exception of the one 
containing the least number moved by y and z, and on this set, there is some i such 
that the action of y % is equal to the action of z; that is, y and z share £ —1 p-cycles, 
and move the same points, and on the p points on which they differ, one is a power 
of the other. Suppose that k ~ i £~ 1 > ^zy- Since every equivalence class contains 
p — 1 elements of [x], there is one class containing at least 2 elements of [x] OH. 
However, their quotient is a single p-cycle, thus H contains a p-cycle, which is only 
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possible for p > k — 4, contradicting our assumption for k > 7. Hence, we cither 
have k < 6 or k ~ i £~ 1 < ^ry- For p — 2 this argument does not apply, while for 
p = 3, 5 it is not very efficient. For these cases we argue as follows. In S5, the only 
even permutations which do not consist of a single cycle of prime length are the 
identity and the permutations conjugate to (12) (34). We call a set A of elements 
in 1S5 admissible, if the subgroup generated by all elements err -1 , a, r e A are of 
this form, that is, if there is some conjugate of the Klein four group containing all 
elements err -1 . By direct inspection we find that an admissible set consisting of 
elements conjugate to (12) (34) contains at most 3 elements, an admissible set of 
3-cycles contains at most 4 elements, and an admissible set of 5-cycles contains at 
most 2 elements. We now form subsets of [x] in the following way: For p = 2 we 
choose 5 points {ai, . . . , 05}, and i — 2 pairs of points [x\, y\), . . . , {xi-2, yt-2), such 
that all points a,i,Xi, yi are distinct, and consider the set of all permutations which 
interchange Xi and yi, and act as the product of two transpositions on {a\, . . . , CI5}. 
Similarly, for p — 3, 5 we choose five points and £ — 1 cycles of length p, and form 
the set of all permutations which act as prescribed on the I — 1 cycles, and as an 
arbitrary cycle of length p on {a\, ... ,05}. We do so for all choices of the five 
points and the cycles. The number N of elements in one subset equals the number 
of permutations conjugate to (12)(34), (123) or (12345), respectively, in S5, that 
is, it equals 15, 20, or 24. On average, the proportion of elements contained in 
H among all elements in a subset is the same as the proportion of elements in 
H among all of [x], thus, there exists some subset containing at least ^rpjp ■ N 
elements in H . The quotient of two elements in one subset moves at most 5 points, 
and if this quotient acts as a cycle of prime length, we obtain k < 9 or that H is one 
of A n , S n - In other words, if H ^ A n ,S n , the restriction of the action of a subset 
to the five-point set is admissible, and using the bounds for the size of admissible 
sets we obtain ^rfer^ < \ f° r P — 2, 3, and ^tctt^ < j2 ^ or P = ^> an< ^ therefore 
the same bounds for k ~ l £~ 1 ■ 

Now suppose that k > 24. Then we have \H\ < 2 k , and \[x] n H\ > As a 
function of £, \[x}\ is unimodal, thus we have 

. / kl kl 

L Jl " V(jfe-p4,)!W ' (k-p[k/p\)l[k/p\lpl k /pi 

where 



to = 



P>7, 



( P -2)fc-p+r 
p(p-i) 

fl-1, P = 2,3 



is the lower bound for I obtained above. We therefore obtain the inequality 



2 k > \H\ > Ifxlniil > ^ > - min 



x 



1 . / kl kl 



k ~k \(k-peo)l£olpk' (k-p[k/p\)l[k/pj\pl k /pi. 

and a simple computation shows that this inequality does not hold true for any 
k > 25. 

Finally, for k < 50 the primitive groups were tabulated by Sims [lb and are 
readily available under a computer algebra system such as GAP[1]. There are 154 
primitive groups of degree < 24 which have to be checked individually. This work 
is feasible, since among these groups there are 45 symmetric or alternating groups, 
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and most other groups can be discarded using the trivial estimate \[ir] t~)G\ < G. 
There remain only the cases C 2 k C5 acting on 5 points, and PSL3(¥ 2 ) acting on 
7 points, which lead to the exceptions mentioned in the theorem. 

5. Computational examples 

In this section we prove Propositions [3] and 01 beginning with the former. 
The following table lists the subgroups of S3 together with the number of fixed 
points of (12) and (123) under the coset action. 



Generators 


Order 


Fixpoints of (12) 


Fixpoints of (123) 


(12), (13) 


6 


1 


1 


(123) 


3 





2 


(12) 


2 


1 





(13) 


2 


1 





(23) 


2 


1 





id 


1 








Similarly, for 


D w , denoting by n, . . . , 


T5 


the reflections, we have the following. 


Generators 


Order 


Fixpoints of t\ 


Fixpoints of T2 


n,T 2 


10 


1 


1 


T\T 2 


5 








Tl 


2 


1 


1 


T2 


2 


1 


1 


T3 


2 


1 


1 


TA 


2 


1 


1 




2 


1 


1 


id 


1 









Denote by Xi, X%, x 4 the number of orbits, on which one symmetric group acts 
similar to the action on the cosets of S3, A3, and 1, respectively, and let X3 be the 
number of orbits on which the action is similar to one of the coset actions of one 
of the 2-element subgroups. Similarly, denote by 2/1, ■ • ■ ,2/4 the number of orbits 
for the other symmetric group. Finally, denote by zi, 22,24 the number of orbits 
on which the action of D\q is similar to the action on the cosets of -D10, C5 and 1, 
respectively, and by Z3 the number of orbits of size 2. 

Then we obtain the following conditions: 

xi,x 2 ,x 3 ,x 4 , 2/1,2/2,2/3, y*,zi,Z2,za, z 4 > 

xi + 2.X2 + 3x3 + 6x4 = 

2/1 + 2t/2 + 3j/ 3 + 62/4 = 

Z\ + 2z 2 + 5z 3 + 10z 4 = 

x\ + 2x 2 = 

xi + x 3 = 

Vi + 2/3 = 

The linear form to be maximized is 

^(X1,X 2 ,X 3 ,X 4 , 2/1, 2/2, 2/3, 2/4,^1,^2, ^3,^4) = 

- (xi + x 2 + x 3 + x 4 + 2/1 + 2/2 + V3 + 2/4 + zi + z 2 + Z3 + z 4 ) 
+ (xi + 2x 2 + 2x 3 + 3x 4 ) + (2/1 + 2j/ 2 + 22/ 3 + 32/ 4 ) + (zi + 2z 2 + 3z 3 + 5z 4 ) 




1 
1 
1 

2/i + 2 2/2 

zi + z 3 

Z\ + Z3 
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Since the domain described by the equations and inequalities is convex, and this 
domain as well a sthe linear form ell is symmetric with respect to the reflection 
x i 4+ Vii we see that the maximum of I on this domain is the same as the maximum 
under the additional constraint Xi = y%. Therefore, we obtain the new system 

Xx,X2 i X 3 ,X4,Z 1 ,Z2,Z 3 ,Z4 > 
X\ + 2X2 + 3x3 + 6x4 = 1 
zi + 2z 2 + 5z 3 + 10z 4 = 1 

Xi + X 3 = Zi + z 3 



with linear form 

£'(xi,X2,x 3 ,X4 l , zi,z 2 , z 3 , z 4 ) = 2x 2 + 2x 3 + 4x 4 + z 2 + 2z 3 + 4z 4 

Increasing X2 by 3e, and decreasing x 4 by e does not change the conditions, but 
increases the value of £' by 2e, hence, in the optimum we have x 4 = 0, and similarly 
we deduce z 4 = 0. If x\ and X2 are increased by e, and x 3 is decreased by e, the 
equations remain valid, and the linear form is not changed, thus, we may assume 
that x 3 — 0. Similarly, if we increase z\ by e, z 2 by 2e and decrease z 3 by e, the 
value of £' does not change, and we obtain z 3 = 0, thus, x\ = z\. We therefore 
obtain the system 

X\ + 2x 2 = 1 
xi + 2z 2 = 1 



with linear form 

£"{xi,X2,Z 2 ) = 2x 2 + z 2 , 

which has obviously the optimal value fj, = |. 

We now compute ^(S^ *c 2 x.c 2 Si) with amalgamation as described in Proposi- 
tion H 

We first give a complete list of subgroups of 5 4 together with the induced actions 
of the two subgroups. Let tj., ... ,75 be the transitive actions of C2 X C2, where t\ is 
trivial, r 5 is regular, t 2 is the action on the cosets of {1, (12)(34)}, t 3 corresponds to 
{1, (13)(24)} respectively {1, (12)}, and r 4 corresponds to {1, (14)(23)} respectively 
{1,(34)}. We can simplify our computations, since we are only dealing with one 
vertex group, it is easy to see that in this case the induced action only depends on 
the conjugacy class of the subgroup, not on the subgroup itself. Thus, we only have 
to consider 11 distinct representations of S4, the relevant information is contained 
in the following table. 
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Subgroup 


Index 


Representation of U\ 


Representation of U2 




(Name or generators) 




n 








T5 


Tl 


T2 


T3 




T5 


Pi 


04 


-1 
1 


1 
1 


n 
u 


n 
u 


u 


u 


1 
1 


n 
u 


n 
u 


n 
u 


n 
u 




A4 


2 


2 

















1 











P3 


(12), (13)(24) 


3 


3 














1 


1 











PA 


(12)(34), (13)(24) 


6 


6 

















3 











P5 


(12), (123) 


4 














1 








1 


1 





Pe 


(1234) 


6 





1 


1 


1 








1 








1 


P7 


(12), (34) 


6 





1 


1 


1 





2 











1 


PS 


(123) 


8 














2 














2 


P9 


(12)(34) 


12 





2 


2 


2 








2 








2 


Pw 


(12) 


12 














6 








2 


2 


1 


Pll 


id 


24 














6 














6 



From these table we find that our linear problem has 22 variables x\ , . . . , x\\ , y\ . . . , yu, 
corresponding to the 11 representation of each factor, and the equations 



11 

^ n % Xi = 1 

i=l 
11 

^2 rHVi = 1 

i=l 

xi + 2x 2 + 3x 3 + 6x4 = 2/1+2/3 + 2y 7 

x 6 +x 7 + 2x 9 = ?/2 + J/3 + 3t/ 4 + 2/6 + 2y 9 

x 6 +x 7 + 2x 9 = y 5 + 2y 10 

x 5 + 2x s + 6x w + 6xn = y 6 + y7 + 2y 8 + 2y 9 + y w + 6y n 

where rii is the number of points pi acts upon. The linear form to be optimized is 

11 11 
£(xi,...,x n ,yx,...,yu) = - ^x t 

i=l i=l 

Xi + 2X2 + 3.T3 + 6x4 + X5 + 2xq + 2^7 + 2^8 + 4Xg + 6X10 + 6xn. 

Solving this linear program we find that the optimum is attained in the point 
X4 = , xn = yj = i, and all other variables equal to 0. The value of the form 
in this point is j, thus, we find /J,(T) = j. 

The computation of the Euler characteristics is straightforward in both cases. 

Note that in the second example the optimising tuple contains two non-zero 
values Xi, that is, different from the case of free products of finite groups it is not 
true that for almost all homomorphisms (p : T — > S n the restriction to a finite 
subgroup U decomposes into orbits on almost all of which U acts in the same way. 
This observation makes the existence of a simple relation between /Lt(r) and group 
theoretic data of T rather unlikely. 
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